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ABSTRACT 

This paper is an extension of "Referential Consulting 
Networks" which explicated the concept of a network of referential 
consultants each of whom could "field" questions by; (a) answering 
them on the basis of his own expertise; (b) answer them with the help 
of library resources at his command; (c) refer the question to a 
colleague he judges to be more skilled than he in (a) , (b) , and (c) . 
The querist, who originates a question of concern to him, is part of 
this network too. The question of primary concern in this paper is 
the trade-off between turn-around time {response time) and quality of 
the response. Small response time and high quality of the response 
both contribute to total benefit; also to total cost. A key factor 
determining both response time and quality is the quality of the 
directories available to the various referential consultants in the 
organization that services queries. A directory, exemplified by the 
"Yellow Pages", or a library catalog, points its user to the optional 
library resources and colleagues among which he makes choices. To 
design a referential consulting network is to; (1) select the number 
and kinds of referential consultants; (2) specify the director^ 
which characterize each unit; <3) specify the way these unitL 
interconnected. {Other papers from this conference are available as 
LI 003360 - 003370 and LI 003372 through LI 003390) (Author/NH) 
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1 * Introduction . 

This paper is an extension of "Ref erential Consulting Networks 1 ' , in 
which we explicated the concept of a network of referential consultants 
each of whom could '■field" Questions by: (a) answering them on the basis 
of his own expertise; (b) answer them with the help of library resources 
at his command; (c) refer the question to a colleague he judges to he 
wore skilled than he in (a), (b), and Cc) . The querist, who originates 
a question of concern to him, is part of this network zoo, He need not, 
however, know how his request is processed between the time he submits 
it and the time he gets a response- -even if it is only the first pass 
in a multi-pass query negotiation "dialogue". If his request leads to 
extensive but productive library searches or to quality-improving ?buck- 
passing", he will notice this only as increased turn-around time* 

The question of primary concern in this paper is the trade-off between 
turn-around time (response time) and quality of the response. Small response 
time and high quality of the response both contribute to total benefit; 
also to total cost. A key factor determining both response time and 
quality is the quality of the directories available to the various referential 
consultants in the organization that services queries. A directory, ex- 
emplified by the "Yellow Pages", or a library catalog, points its user to 
the optional library resources and colleagues among which he makes choices 
(b) and (c). It might also jog his own memory in choice (a), but we will 
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ignore that in this paper. The directory serves both to prompt and to teach, 
but again we confine our study to only the prompting function. 

To design a referential consulting network is to^l) ' selects the: iiunfcer 
and kinds of referential consultants — each of whom is thus a potential 
switching point, with the possibility that some units in the organization 
are exclusively switching centers; — (2) specify the directories which 
characterize each unit; (3) specify the way these units are interconnected. 

We then ask how the choice of a consulting network affects benef itr-cost 
ratio, and we attempt to search for that organization, or its properties, 
which maximize it. 



2 • Review of the Literature; Evaluation of Trends . 

Interest in communication networks as objects of mathematical and 
experimental study began in 1948 6 * 7 with Bavelas' work on task-ofiented groups 
A team of people paid experimental subjects — were seated around a 
round table with, say five radial partitions between them, as shown. 

There were slots such as in mail boxes, into 
which each subject could drop a message, 
which would be delivered to one or more 

specified people according to a particular network scheme. The entire 

teaip was given a task which required cooperation and communication. The 

aim was to investigate the effect of different networks on performance. 

26 

Leavitt, in 1951 , examined four basic patterns of communicati on 
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He found that leaders emerged in the i’fork" and "wheel" structures (positions 
C and E) ; also, that the wheel is administratively most efficient at in- 
formation processing. In the chain, A and B were never perceived as 
leaders • 

In 1954, we began a mathematical investigation of such networks, 

with the aim of relating the flow of information to the performance of the 

36 8 

organization. We believed, at the time, as did Rothstein , Brillouin , 

and Watanabe* . to mention but a few investigators, that a measure of the 

"degree of organization", analogous to Shannon’s measure of the "amount 

of information" could perhaps be created and used to prove theorems about 

the "emergent" properties of organized assemblies of numerous parts. 

39 

It was not until unvNeuraann introduced the beautiful idea that an 

assembly of unreliable parts, suitable organize could in its 

entirety function like one of the parts but with arbitrarily high reliabilty, 

that a major conceptual advance took place. At the same time, the economist 

30 

Marschak began to develop a theory of teams which led later to profound 

insights irto the economics of information. In 1958, we connected some 
18 38 

of these notions . In 1960 ? Shannon and Moore made a significant advance 

on how to make a reliable switch with less reliable components, and m 

1964, Winograd and Cowan crowned this line of investigation with definitive 

results about the reliability of networks, analogous to the coding theorems 

40 

of information theory , In a sense, this provided a satisf actory ansv/er 
to what switching networks can do that could, in principle, not be done 
without them. 

At a less profound level, switching networks have been extensively 

3 

studied since the days of the first computers. Since at least the 

*In private communication. 
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31 

pioneering work of McCulloch-Pi t ts it was understood that logic could 
be performed by switching networks. Of course, computers are built of 
switching networks, and there exists an ; enormous literature on how to 
find the cheapest and most effective networks to act as a specified switch- 
ing functional 

At an even more practical level, the proliferation of computers and 
terminals — over 50,000 installations exist in the U.S. — telephones, 
copying machines, etc. — led both "sociological engineers* 1 and computer 
scientists to concern themselves with "switching networks* 1 . The early 
experiments with time— sharing at MIT and SDC led to the exciting concept 
of an "on-line intellectual community . u IBM began to concern itself with 
total systems approaches as early as 1956 • Far-sighted engineers began 

Ol, 

to investigate computer networks. Experiments like DICO and SASIDS , 
which extended the notion of SDI to that of a network in which each member 
acts both as a source of recommended literature and as a recipient of 
information selectively disseminated to him, showed the value of such 
exchange nets. 

And, at a commercial level , airline and hotel reservation systems 
proved to be extremely cost-effective. Though they required the siriTiourrting 
of such technological hurdles as the development of a reliable magnetic 
disk, the conceptual problems were simple, primarily because only a very 
specialized demand; - — just two or three stereotyped questions or requests — 
had to be serviced. The service does, however, require a switching net 
involving thousands of switching centers , and response time in seconds Is 
as important as up** to** the— minute updating of rather large files. 
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The notion of networks in library and information science arose at 

several levels. It may well have been inspired by the various attempts 

129 13 33 

to use graph theory in thesaurus design * * • * . Interlibrary 

communication nets are, of course, not new, though the use of communication 

channels, such as the one between N*Y*C* and Albany is fairly recent* 

Systematic studies gathered momentum at the 1967 Educom conference. A 

32 

careful study of regional networks was made in 1968 by Meise . In 1969, 
Duggan 10 analyzed communication networks of libararies , raising such questions 
as: How can configurations be evaluated? and What is the best type of 

network configuration? We shall see how the model we present later can 
help answer these questions* 

In '"Referent! al Consulting Networks" ~we argued for a new, expanded 

role for the reference librarian^ 1 , . as precisely the kind of switching 

point in a network such as we are discussing here. We noted the work of 

Grogan 16 , indicating some typical questions that reference librarians 

2 8 12 35 

ire requested to service, the viewpoints of Lorenz Freiser and Rees 
on the division of responsibilities among libraries and information centers 
in this regard, and such experiments in the use of libraries as community 
information centers*** 1 ^. Aspens^. has « argued that contemporary reference 
librarians already have a status comparable to that of- doctors, engineers, 
lawyers* Shera and Egan 11 proposed an important revision to the classical 
definition of librarianship (a collection of books organized for use) 
by asserting its function to be "to maximize the effective social utilization 
of the graphic records of civilization". In "Referential Consulting Networks" 
we proposed a further revision of this to read: "to maximize the greatest 

potentially attainable effective and efficient social utilisation of 
documented knowledge". And that is where networks come in. 

5 
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If the literature shows any trends, it is perhaps an increasing concern 
the benefits of networks. Professionals at well— endowed, large libraries ** 
and computing centers — — are hard-pressed to find u ses for communication 
to or from other institutions if a better network were available. Many 
investigators and enterpreneurs and managers seem to favor centralized 
facilities; small, stand-alone facilities (minicomputers, personal or 
departmental libraries) for those who can afford them and and large centers 
to be shared by all the others. 

But this trend tnay not last. In a series pf papers aiming at building 

22 23 24 

a -theory of decentralization K.W. Deutsch and I * * have shown that 

historical trends favor decentralization: networks* with distributed 

switching centers. This is primarily due to the increase in the volume of 
requests to be serviced. For an organization to remain responsive, and 
minimi otal cost, the number of dispersed service facilities should 
increase predominantly as the square root of the load. I believe there 
will be a trend toward larger centers and satellites organized into a de- 
centralized network, but this trend is not yet evident in practice. This 
paper is a contribution to develop the theoretical basis. 

3* Directory Design Parameters . 

Imagine an organization of n+l active u^its or potential switching 
points labeled 0 , 1 , 2 , . . . , i , . . . , n. Interpret 0 to designate the 
querist. Let designate the directory at l*s disposal, for i 53 0, 1 * .,,, n, 
and picture to be represented as a table like that of Figure 1. Al- 
ternately, picture i t as a black box with on* 2 of acceptable inputs and 
as many corresponding outputs. The set of inputs or entries resemble the 
entries to a library or parts catalog, a classified directory like the 
Yellow Pages , or an encyclopedia: they are a mixture of subject-headings ; 

i 
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and proper nanes, in terms of which any query is to bo represented. The 
output corresponding to each input is a list of surrogates for either 
documents op colleagues in the organization or both. 

Let be the average number of document-surrogates per entry and let 
L be the number of "cplleague"-surrogates per entry. Thus, M^+L^ is the 
average total number of surrogates from which the directory user can pick 
one when he enters the directory with a term that matches. If m^ is the 
average number of bits per document-surrogate and 1^ that for a colleague- 
surrogate and b^ is the average number of bits per entry, then the entire 
directory takes (bj+M m^+L^ip bits to store. If it takes T seconds to 
check if a given term matches some entry in the directory and the entries 
are kept in order, it takes approximately T log seconds to locate a row 
in the directory if the input term matches some entry. To this should be 
added the time, T' seconds, it takes the directory user to read the output 
and make a choice terminating in a new input registered in the system. 

I . 

Basically, i will have used the directory in response to a query. 

He m^st judge, for relevance to the query, document or colleague surrogates 
which are the outputs of the directory. His relevance judgment can be 
faulty for two reasons: (1) the surrogate, which is all he has on which to 
base his judgment does not accurately reflect the relevance judgment he 
would have made had he encountered the document or colleague directly; 

(2) his relevance judgment does not correspond to the requirements of the 
query. 

For example, suppose that () requests of ^1 the combination to his bank 
safe, which he lost, giving X his name. Now ,1 consults his directory, 
locates ,0 1 s name and finds listed surrogates of two documents and three. 
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col leagues, 8 ay the "List of all active Savings Accounts" and " 2 , Vice 
President- in charge of Safe Deposits", ete. 1 should pick the third 
surrogate. It is possible that 2 does net have in his directory a direct 
surrogate for the book of cognations either, but only something like, 

"3 officer in charge of customer access". Then 1. should refer the query 
to 2 who refers it on to 3 who, hopefully, is pointed by his directory 
to the document containing 0> combination. Of course, if 0 could see the 
union of the entries in all the directories of JL, !• and 2» he could have 
contacted 3, rather than 1 in the first place. Even better, if 0 had the 
document of all combinations himself he would not have had to bother anyone. 

Let Q be the set of all possible queries — assumed to be characterized 
by a single term suitable as input for matching a directory entry - with 
which 0 might ever enter the system. Let Dom(D Q ) be the set of entries 
in his directory. We shall assume, for purposes of analysis, that he 
does not rely on his own memory at all, only on this directory. Clearly:: 

N *» 3 Dom(D ) 1 . 

o • O • * 

Assumption I t N q < | Q and if, for some q e Q, q i Dom<D 0 ) , this query 
is switched to 1* 

Assumption 2 : Q Dom^) and if q { Dom(D i ) , this query is switched 

to i+1 1 i *= 1> •••* ft* 

Theorem 1 : Every query in Q will match an entry in some directory, and 
it will take at most T log 4 Jfj Nj seconds to effect this match 
Assumption 3 t Surrogation is perfect and i makes no errors in judging 
relevance, 1 = 0, 1, 2, • • • » n. 

The reason that a directory in which q matches an entry would fail 
to produce the desired response to 0 for q, even though the output 

O 
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is relevant, is that the output is not yet direct. It may be indirect, 
pointing correctly to another place where the search can be narrowed down. 
Will it always be narrowed down, or could it get more diffused? Could 
it go in non-ending cycles? 

If I refers a query q to j who has in his directory pointers which 
lead q back to i, then i has erred in referring to j. ' If i can neither, 
through his directory, find an answer to qy nor find some j who can either 
find an answer or find some k.who can either . . . , then the question 
cannot be answered, and i should so infprm 0. 

«r 

4. A Computer Program for Analyzing Referential Consulting, Nets * 

We present in this section ait operational FORTRAN program, created 
by A, Breveleri, . R. Chlopan, W. Everett and A. Tars for this paper. It 
can' be used by anyone to simulate a great variety of proposed configurations 
of networks of switching centers with directories. We shall show how to 
use it and one result of i tt> use. The program resembles simulators like 
that of Gordon 1 ^ and S1MSCRIPT 29 , but it is not a programming language. 

To conform to FORTRAN notation and to simplify exposition, we relabel 
th^ following key variables • 

LP: number of people (referential consultants, switching centers) - was n, 

LQ: number of questions a directory can match was * |q| all i 

LD? total number documents containing answers, 

A particular configuration of switching centers to be analyzed is 
specified by four input arrays. The first array, called MANS , consists 
of LP answer-directories, one for each person. Each directory is in the form 
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of an LQ x ADEPTH matrix}^? in which an entry is any integer* from 0,1,2, ... 
to LD + LP. We denote the people by the integers 1,2, .»., LP and the 
documents by LP + 1, LP + 2, ..., LP + LD. Each row denotes one of the 
LQ questions; the entry in each row is the set of people or documents 
each of which is known , by the directory user, to contain the answer. 

Zeroes are used simply to fill out the matrix, the columns denoting nothing. 
Thus, if there are LQ = 4 questions, LP = 2 people (labeled 1, 2) and 
LD = 3 documents (labeled 3, 4, 5) an answer-directory for person may 



be: D t = MANS 



? 


4 


L5. 


3 


0 


0 


0 


0 


0 


2 


3 





ADEPTH ( here « 3) is maXj (L.,-^) in the notation 



of section three. We read this as: If R^ gets question 1 (first row), he 

can get the answer by asking or looking in documents four or five. If 
he gets question 2 (row 2), he can get the answer only from document three. 

He can't- get an answer to question three at all, and he can get the answer 
to question four by asking R 2 or looking. in documents three or five. 

•Hie second array, called MREF, consists of LP "buck-passing" directories, 
one for each person. Each is given as an LQ x RDEPTH matrix, with entries 
0, 1, ..., LP. Each tow again denotes one of the LQ questions. Posted next to 
each entry are not more than RDEPTH other people, each of whom the directory user 
thinks can obtain an answer to that question. Thus, for R^, as above, we 



might have MREF 



2 

0 

2 

IX 



with RDEPTH = 1 (it couldn't be greater here). 



Here, R^ thinks that if he referred any question but 2 (row 2) to R 2 , Rj 
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could either answer It or refer it. more appropriately than could - 

The third array # called MACOST, consists of LP answering-cos t-matrices 
one for each person. Each matrix, for R^, has LQ rows and LP + LD columns. 

An entry in row j, column k is any positive real number, representing the 
cost to of getting the answer to question j from source k. (Recall * 
that k = 1, • • <= , LP is a person, and k » LP +1, . .., LP + LD are documents.) 

The last array, called MRCOST, consists of LP reference-cos t-matrices 
each being LQ by LP. An entry in row j, column k of this matrix for R^ 
denotes the cost to R^ of referring question j to person k. 

The four arrays are entered as input parameters. The program consists 
of five parts, as shown in the rectangular boxes of Figure 2. The top box 
causes all inputs to be read in* all variables to be set initially. The 
second part, M Ques tion" , reads in a question and the person to whom it is 
originally directed. This can be input or generated randomly by a program. 

We can think of the programmer as being the querist who refers his question to 
one of the persons in the network by his input, or we can think of the querist 
as being the first person in the network who is faced with the question. 

The' basic logic of the next part ’'Action 11 is shown in Figure 3. "Action” 
assuiHss that a given person cannot be asked the same question twice (in this 
version of the program), which rules out bureaucratic cycles. The "Pricing" 
box forms the cost-estimates used in ’’Action". An adaptive feature is built 
in which makes the choices converge to the lowest cost per query. 

The results printed by the first version of the operating program 
("BUCKPASS”) are, for each input question and starting consultant, 

(1) the total cost and 

(2) the chain of referential consultants to whom the "buck” was passed, 
ending with a person or document. 
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Examples for LP « 5, LQ * 5, LD ~ 10, ADEPTH » 10, RDEPTH * 15 

Question Input: Question 5 to Person 1. 

Output: Cost = $10; chain ® 1 -► 2 + 5 13 (a document). 

It should be emphasized that the last link in the chain is not a referral, 

even though the last item in the chain might be a person in the network. 

We distinguish between person i obtaining the answer to a question directly 

from person j (by use of MANS) and person i referring a question - passing 

the buck “ to person j (by use of MREF) . 

A variety of refinements in the program are underway. One important 

improvement is hierarchization of queries. The input question is first 

classified ioto* gross and high-level categories, with the first consultant 

receiving it doing the coarse screening and sending it to one of several 

other generalists, one for each gross category. A second, closely related 

new. feature is the decomposition of the question into parts, and sending, 

in turn, (or copies, in parallel) to specialists on the parts. Thirdly, 

19 

as in , measures of quality are introduced. In place of the MANS matrix, 
we have: 

p(i»j»k) = Probability (iknows k has answer to j and finds it) 

r(l,j,k) = Probability (i judges k relevant to j | k relevant to j) 

q(i,j,k) « Probability (i judges k relevant to j | k irrelevant to j) 

(j,k) ^ Probability (k is relevant to j and provides correct answer) 

Now the output is : 

(1) the total cost per query, obtained by adding the consultant costs 
to the lookup costs. 

(2) The turn-around time, add the times for referral, the times for each 
question part that is delivered and the lookup times. 

(3) The quality of a response is the probability that the answer is correct. 
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This permits us to study a trade-off between quality of responses and 
turn-around time. We can estimate benefits by the expected utility of a 
high quality response. We can now investigate now different configurations 
and directory designs affect benefit-cost ratio. 

5. Use of BUCKPASS 

In this section we present an example of the use of BUCKPASS to analyze 
a particular network model , a wheel configuration with >,n persons • Assumptions 
in this model render the analysis too simplistic for practical use; more realistic 
assumptions, however* would complicate our illustration and would direct 
attention to the model rather than to the use of BUCKPASS. 

In the wheel (fig. 4) the central person, R^, can refer questions to 
any of the persons on the periphery. The peripheral persons, R^, • ••! 
can only refer questions to R^. We consider ten questions, q^, q 2 » » • * » ^10* 
which can be answered by consulting source documents s^, s^, s^ re- 

spectively. (In other models, a person in the network might also be a 
source of answers, e.g. Rj = s^.) We assume that if one person in the 
network knows that the answer to q, can be obtained from s , then no other 

1 j 

person in the network knows (assumption of disjoint answer directories). 

.We assume that persons R 2 , and can answer exactly one question, and 

Rj. can answer questions. It follows that in the center can answer 
= 7-Nj questions. For example, if = 4, we have MANS and MREF in 
fig* 5. 

If we think of ourselves as the querist, we might ask which person in 
the network, R^, R 2 , or R<-, we should address our questions to. We might 
also wish to know the effect of N 5 on the average cost of answering a question 
if the questions are randomly directed to different persons in the network, 

under the following assumptions about costs: 

> 
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1. When a person can answer less than two questions, there is no answer 
directory look-up . 

2. Answer directory look-up proceeds linearly and costs $1,00 for 
each item examined. 

3. The cost of obtaining the answer from the source document is $1.00. 

4. The referral directory is consulted only after failure to match 

in answer directory; hence referral cost includes $N^ when 5 2. 

5. Referral directory look-up proceeds linearly and costs $1.00 for 
^ach item examined. 

6. Communication costs $1.00 for each question referred. 

These assumptions determine the costs in MAC0ST and MRC0ST. In fig. 6, 
these matrices are flattened in the third dimension since there is in this 
model only one source to answer each question, and referral of an unanswered 
question is likewise unique. It should be clear that we have optimal directory 
design under our assumptions (e.g* the fourth item in R^'s referral directory 
is the first item in R^'s answer directory). 

Example: Suppose we direct question q^ to person R<_. 

1# Rj consults his answer directory and fails to match each of the four 
items. He does not consult a referral directory since he refers all 
unanswered questions to R^. Referral cost is 4+0+1 =5. 

2. R^ consults his answer directory and fails to match each of the 
three items. He consults his referral directory and finds a match after 
examining the sixth item. Referral cost is 3 + 6 + 1 « 10, and the 
question is referred to R^. 

3. does not consult an answer directory since there is only one 
question he can answer. He obtains the answer from source document s ^ . 
Answer cost is 0 + 1 = 1. 

14 
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4. To obtain the answer to question q^ by asking R^, the chain is 
5— — ^3 — ►! 1 and the total cost is $16.00. 

In table 1 are shown the average costs for asking all ten questions 
of R 1> R 2 , and R $ as well as the average cost for directing questions randomly 
to any of the five persons in the network. This information is given for 
each of the values of N y For N 5 « 7, R x acts only as a switching center 
and can answer no questions. The case = 0 is of no interest since we 
would be dealing with a four person network with the option of sending a 
question directly to R^ or indirectly through a $1.00 communication channel 
R^. The effect of cost assumption 1 is apparent for = 6. With that ex- 
ception, the cost decreases as the expertise of increases. Except when 
Nj. *= 7, R 2 is the best entry point to the network under these assumptions. 

We can modify our cost assumptions and observe the resulting effect 
on the cost of the network. If we replace cost assumption 5 by 

5*. Referral directory look-up is categorical, proceeds linearly, and 
costs $1.00 for each category examined, 
we have MRCOST as in fig. 7 (with N*. = 4) . Questions q^, q 2> q^, and q^ 
match the first item in R^'s referral directory, that item being the category 
of questions referred to R^. In table 2 we see the results of this model. 

The reduction in referral costs has made the optimal entry point to the 
network. However, if we never use R<- as an entry point, the minimum cost is 
obtained when R^ can answer four or five questions, rather than six. This 
contrasts with the first model in which the lowest cost was obtained when 
had maximum expertise. 

A more interesting use of BUCKPASS would be to allow referral of any 
question to any of the other persons in the network and to determine what 
distribution of ques t ion* answering capabilities and what cost assumptions 
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ause t he model to converge to a wheel configuration of preferred coramunicat Iot 
links . In the example described above there were no alternative paths and 
consequently no opportunity for convergence* 

A refinement incorporated in BUCKPASS II allows the user t-j specify 
implicit cost functions, eliminating the need to provide the cost matrices 
as input data. With the additional output statistics mentioned in the 
preceeding section, we have a powerful tool for readily determining cost- 
benefit ratios of referential consulting networks under different directory 
designs, distributions of question answering capability, and cost assumptions. 
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